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Abstract — In this work, we propose low-complexity adaptive 
biased estimation algorithms, called group-based shrinkage esti- 
mators (GSEs), for parameter estimation and interference sup- 
pression scenarios with mechanisms to automatically adjust the 
shrinkage factors. The proposed estimation algorithms divide the 
target parameter vector into a number of groups and adaptively 
calculate one shrinkage factor for each group. GSE schemes 
improve the performance of the conventional least squares (LS) 
C*") estimator in terms of the mean-squared error (MSE), while 
"^ requiring a very modest increase in complexity. An MSE analysis 
CD is presented which indicates the lower bounds of the GSE schemes 
On with different group sizes. We prove that our proposed schemes 
5^ outperform the biased estimation with only one shrinkage factor 
O i and the best performance of GSE can be obtained with the 
<** maximum number of groups. Then, we consider an application 
1 of the proposed algorithms to single-carrier frequency-domain 
O^l equalization (SC-FDE) of direct-sequence ultra-wideband (DS- 
CN| UWB) systems, in which the structured channel estimation 
(SCE) algorithm and the frequency domain receiver employ the 
f— "" ' , GSE. The simulation results show that the proposed algorithms 
J significantly outperform the conventional unbiased estimator in 
the analyzed scenarios. 

Index Terms-DS-UWB systems, parameter estimation, in- 
terference suppression, biased estimation, adaptive algorithm. 
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I. Introduction 

In this work, biased estimation algorithms are considered 
in two common deterministic estimation scenarios in com- 
munications engineering, which are parameter estimation and 
interference suppression |Q]-||5). It is known that under the 
assumption of AWGN, the least-square (LS) algorithm can 
provide an efficient solution to these estimation problems and 
will lead to minimum variance unbiased estimators (MVUE). 
The unbiasness is usually considered as a good property for an 
estimator because the expected value of unbiased estimators is 
the true value of the unknown parameter [6|. However, in some 
scenarios the LS method is not directly related to the mean 
square error (MSE) associated with the target parameter vector 
and it has been found that a lower MSE can be achieved by 
adding an appropriately chosen bias to the conventional LS 
estimators 1171. lUll . Note that some reduced-rank techniques 
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also employ a bias to accelerate the convergence speed 

ea. 

A class of biased estimator that has been studied in recent 
years is known as the biased estimators with a shrinkage factor 
ll71- lfT4l . These biased estimation algorithms have shown their 
ability to outperform the existing unbiased estimators espe- 
cially in low signal-to-noise ratios (SNR) scenarios and/or with 
short data records [9 1. For these biased estimators [7 1-[14|, the 
complexity is much lower than for MMSE algorithms because 
the additional number of coefficients to be computed is only 
one. The motivation for the group-based shrinkage estimator 
(GSE) is to find a generalized estimator with a number of 
shrinkage factors that can achieve a better performance and 
complexity tradeoff than the biased estimator with only one 
shrinkage factor. 

In the parameter estimation scenario,some biased estimators 
have been proposed to achieve a smaller estimation error 
than the LS solutions by removing the unbiasedness of the 
conventional estimators with a shrinkage factor in the param- 
eter estimation scenario. The earliest shrinkage estimators that 
reduce the MSE over MVUE include the well known James- 
Stein estimator [10| and the work of Thompson [11|. Some 
extensions of the James-Stein estimator have been proposed in 
lfT2l - lfl5l . In fl6l . blind minimax estimation (BME) techniques 
have been proposed, in which the biased estimators were 
developed to minimize the worst case MSE among all possible 
values of the target parameter vector within a parameter set. If 
a spherical parameter set is assumed, the shrinkage estimator 
obtained is named spherical BME (SBME) lfl6l . 

For the interference suppression scenario, the biased esti- 
mators can be employed to achieve a lower estimation error 
between the estimated filter and the optimal linear LS estima- 
tor. The major motivation for adopting the biased algorithms 
here is to accelerate the convergence rate for the adaptive 
implementations and provide a better performance with short 
training data support in long filter scenarios ifPJI . 

To the best of our knowledge, biased estimators with 
shrinkage factors are rarely implemented into real- world signal 
processing and have not been considered in the frequency 
domain for communication systems. One possible reason is 
that some assumptions required for the signal model may not 
be satisfied. For example, in time-hopping UWB (TH-UWB) 
systems, the multiple access interference (MAI) cannot be 
accurately approximated by a Gaussian distribution for some 
values of the the signal-to-interference-plus-noise ratio (SINR) 
[17|. Another possible reason is that the existing shrinkage- 
based estimators usually require some statistical information 
such as the noise variance and the norm of the actual parameter 



vector. In our previous work ifPTl and lfj"4l . adaptive biased 
estimation algorithms with only one shrinkage factor have 
been proposed to fulfill the tasks of interference suppression 
and parameter estimation. In this work, a novel biased es- 
timation technique, named group-based shrinkage estimators 
(GSE), is proposed. In this algorithm, the target parameter 
vector is divided into several groups and one shrinkage factor 
is calculated for each group. Least mean square (LMS)-based 
adaptive estimation algorithms are then developed to calculate 
the shrinkage factors. The GSE estimators are able to improve 
the performance of the recursive least squares (RLS) algorithm 
that recursively computes the LS estimator. In DS-UWB 
systems, the estimation tasks are usually very challenging 
because the environments include dense multipath. In this 
work, in order to test the proposed algorithms, we consider 
applications of DS-UWB systems with SC-FDE. Specifically, 
we concentrate on the channel estimation and interference 
suppression with the proposed algorithms. The MSE perfor- 
mance of the proposed GSE schemes is then analyzed, a lower 
bound of the MSE performance is derived and the relationship 
between the number of groups and the lower bound is set up. 
Simulations show that with an additional complexity that is 
only linearly dependent on the size of the parameter vector and 
the number of groups, the proposed biased GSE algorithms 
outperform the conventional RLS algorithm in terms of MSE 
in low SNR scenarios and/or with short data support. It should 
be noted that the proposed GSE estimator can be employed 
for applications where a high estimation accuracy is required. 
These include localization in wireless sensor networks [28 1 
and in dense cluttered environments with UWB technology 
||29l . The proposed estimators can also be employed into 
emergent multicast and broadcast systems (3), such as the 
orthogonal frequency-division multiplexing (OFDM) based 
multi-user multiple-input multiple-output (MIMO) systems as 
specified in the IEEE 802.1 lac standard and the 3GPP long- 
term-evolution (LTE) systems. 

The main contributions of this work are summarized as 
follows: 

• Novel GSE schemes are proposed to improve the per- 
formance of the frequency domain RLS algorithms in 
the applications of parameter estimation and interference 
suppression in DS-UWB systems. 

• LMS based adaptive algorithms are developed for both 
scenarios to adjust the shrinkage factors. 

> The MSE analysis is carried out which indicates a lower 
bound of the proposed estimator and the relationship 
between the lower bound and the number of groups. 

> The performance of the proposed biased estimators is 
examined in multiuser SC-FDE for DS-UWB systems 
with the IEEE 802.15.4a channel model, convolutional 
and low-density parity-check (LDPC) codes. 

The rest of this paper is structured as follows. In Section HI1 
we first review the LS solution for the parameter estimation 
scenario and present the structured channel estimation (SCE) 
problem in SC-FDE of DS-UWB systems. Then, the signal 
model of the frequency domain receiver design for DS-UWB 
systems that represents the interference suppression scenario, 



is presented. The proposed GSE scheme and its adaptive 
implementations for the parameter estimation scenario and the 
interference suppression scenario are developed in Section UITl 
and Section [IV] respectively. The MSE analysis is shown in 
Section [V] The simulation results are shown in Section |VT1 
Section [VHl draws the conclusions. 



II. System model 

In this section, we introduce the channel estimation and 
receiver design tasks in the frequency-domain of DS-UWB 
systems with SC-FDE that represent the parameter estimation 
scenario and the interference suppression scenario, respec- 
tively. 



A. Problem statement for the parameter estimation scenario 

The linear model for the parameter estimation scenario can 
be expressed as: 

y = Xh + n, (1) 

where the training data matrix X E c MxL anc [ the received 
signal y E C Mxl are given, n is AWGN with zero mean and 
variance a 2 . In this scenario, the typical target is to estimate 
the parameter vector h E C Lxl that leads to the minimum 
MSE. The MSE consists of the estimation variance and the 
squared bias and is given by 

E{\\h-h\\ 2 } = E{(h-E{h}) H (h~E{h})}+[\\E{h}-h\\% 

where E{} represents expectation of a random variable. 

The conventional LS algorithm estimates the parameter by 
minimizing 



J hS (h) = \\y - Xh\\ 



(2) 



~H 



Assuming that the matrix X X is a full rank matrix, the LS 
solution is given by 



h LS = (X"X)- i X ti y 



(3) 



Under the assumption of AWGN with zero mean and variance 
a 2 , the LS estimator is a MVUE that leads to a minimum MSE 

E{\\h-h LS \\ 2 } = E{(h LS -h) H (h LS -h)} = var(h,h LS ). 

we define v = var(h, /ils) = tr{a 2 (X X) -1 }, where tr{-} 
represents the trace operator [6|. 

The objective of introducing the biased estimator in the 
parameter estimation scenario is to achieve a lower MSE than 
the unbiased estimator, which can be expressed as 



E{||/i-/i b || 2 }<E{||/ l -/ lLS || 2 }. 



(4) 



Although the objective shown here is similar to MMSE 
algorithms that is to achieve an MSE as small as possible. 
It should be noted that the biased algorithm developed in this 
work adopts a different strategy from MMSE algorithms. 
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Fig. 1. Block diagram of SC-FDE schemes in DS-UWB systems: (a) Parameter estimation scenario, (b) Interference suppression scenario. 



B. System model for the SCE: parameter estimation scenario 

Here, we consider the channel estimation problem of a 
synchronous downlink block-by-block transmission DS-UWB 
system based on SC-FDE with K users. The block diagram 
of the parameter estimation scenario is shown as branch (a) 
in Fig. Q] For notational simplicity, we assume that a A^-by- 
1 Walsh spreading code Sk is assigned to the fc-th user. The 
spreading gain is N c = T s /T c , where T s and T c denote the 
symbol duration and chip duration, respectively. At each time 
instant i, a data vector bk (i) G C N x l is transmitted by the fc-th 
user. We define the signal after spreading as Xk(i) — Dkbk(i), 
where the block diagonal matrix D k e C Mx N (M = N-N c ) 
performs the spreading of the data block and its first column is 
constructed by the spreading code Sfe zero-padded to the length 
of M. In order to prevent inter block interference (IBI), a 
cyclic-prefix (CP) is added and the length of the CP is assumed 
to be larger than the length of the channel impulse response 
(CIR). With the insertion of the CP at the transmitter and its 
removal at the receiver, the equivalent channel is denoted as a 
circulant Toeplitz matrix H cqu 6 C x , whose first column 
is composed of a vector h cqu zero-padded to length M , where 
h eqn = [/i(0), /i(l), . . . , h{L - 1)] is the equivalent CIR. At 
the receiver, a chip matched-filter (CMF) is applied and the 
received sequence is then sampled at chip-rate and organized 
in an A/-dimensional vector. This signal then goes through 
the discrete Fourier transform (DFT). The frequency-domain 
received signal is given by 



A' 



K 



y(i) = FH cqu J2x k {i)+Fn{i) = A H Fj2x k (i)+Fn{i), 



fc=i 



fc=i 



H 



(5) 
where n(i) represents the AWGN, Ah = FH cqu F" is a 
diagonal matrix whose diagonal vector is defined as h and its 
a-th entry is given by h a = J2i=o hi ■ exp{—j(2Tr/M)al}, 
where a € {0, 1,2, . . .,M - 1}. F € C MxM repre- 
sents the DFT matrix and its (a, 6)-th entry is F a ^= 
{l/y/M)exp{-j(2n/M)ab}, where a, & G {0,1,2,..., M- 
1}. By defining a matrix F m ,l G C MxL that contains the 
first L columns of the DFT matrix F, we obtain the following 
relationship 



h = VMF M , L h, 



A/.L'tcqu, 



(6) 



In unstructured channel estimation (UCE), the vector h <G 
C Mxl is directly estimated, while in the structured channel 
estimation (SCE), the fact that L < M is taken into account 
and the vector ft. C qu £ C Lxl is the parameter vector to be 



estimated. The concept of SCE was proposed in 11201 . where 
the SCE shows a better performance than the UCE. In ED . 
adaptive MMSE detection schemes for SC-FDE in multi- 
user DS-UWB systems based on SCE are developed, where 
the estimated h cqu is adaptively calculated based on RLS, 
least-mean squares (LMS) and the conjugate gradient (CG) 
algorithm for the detection and the RLS version performs 
the best. The purpose of developing biased estimation in this 
scenario is to further improve the performance of the RLS 
algorithm in terms of the MSE. 

We consider user 1 as the desired user and omit the subscript 
of this user for simplicity. Note that the frequency domain 
received signal can be expressed as 



y(i) = y/MA(i)F M , L h 



cqu 



n e (i), 



(7) 



where we define a diagonal matrix A(i) = dia.g[Fx(i)}, the 
noise and interference vector n e (i) consists of the MAI and 
the noise and is assumed to be AWGN. As shown in (|7), the 
SCE problem is an implementation example of the parameter 
estimation problem where a given matrix X(i) e £,MxL j s 



defined as X(i 
is given by 



= VMA(i)F M ,L- The LS solution of h equ 

frequ,LsW = -Rh 1 (*)Ph(*) ( 8 ) 

where R h (i) = £* =1 X^ Ff^ L A H (j)A(j)F M , L , p h (i) = 
Y? j= i X i ~ j Ff I _ L A H {j)z{j) and A is the forgetting factor. 
Then the LS solution can be computed recursively by the 
following RLS algorithm ED) 

hRLsi* + 1) - h Rhs (i) + R^(i)Ff UL A H (i)e h (i), (9) 

where eh(?) = z(i) — A(i)FM,Lh-RLs(i) is the M- 
dimensional error vector. 

In Section [TTlJ a novel biased estimation algorithm called 
group-based shrinkage estimator (GSE) is incorporated into 
the unbiased LS estimator that is able to improve the estima- 
tion performance in terms of the MSE. 



C. System model for the frequency domain receiver design: 
interference suppression scenario 

The block diagram of the interference suppression scenario 
is shown as branch (b) in Fig. Q] For each time instant i, 
an TV-dimensional data vector b k {i) = [b k (i), . . . , b k (i)] T 
is transmitted by the fc-th user. After the spreading, the M- 
dimensional transmit signal is given by 



where the matrix V £ 



■<MxM 



IS 



x k (i) = S k b k , e (i) 



(10) 



where the spreading matrix S k £ C MxM , M — N x N c , is 
a circulant Toeplitz matrix and its first column consists of the 
spreading codes and zero-padding [26|. The equivalent M- 
dimensional expanded data vector is 

b k Ai) = lb k 1) (i),0 Ne -ub k 2) (i),0 Ne - l ,---,b k N) (i),0 Ne - l } T 

where (-) T is the transpose. Using this signal expression we 
can obtain a simplified frequency domain receiver design. At 
the receiver, a CMF is applied and the received sequence is 
then sampled at chip-rate and organized in an M -dimensional 
vector. After the DFT, the received signal is given by 



*(*) = Fy(i) 



K 

E 
fe=i 



FH cqu S k b k 4i)+Fn(i), (11) 



where n(i) is the AWGN and F £ C MxM represents the 
DFT matrix. Since both H cqu and S k are circulant Toeplitz 
matrices, their product also has the circulant Toeplitz form. 
This feature makes Afc = FH cqu S k F a diagonal matrix. 
Hence, we have 



A" 



z(i) = ^2 AfcF6 fe ,e(«) + Fn(i). 



fe=i 



We can further expand Fb k ^ c (i) as 

Fb k , c {i) = (1/^)1 e F N b k (i), 
NxN denotes the DFT matrix and I c £ 



where F N £ C 
is structured as 



(12) 



(13) 

■<MxN 



'-N, 



Jn? 



N r 



where In denotes the N-by-N identity matrix. Finally, the 
frequency domain received signal z(i) is given by 



z(i) 



K 

E 



(l/^N c )A k I c F N b k (i) + Fn(i). 



(15) 



Note that the expression in (fl3l l is an implementation ex- 
ample of the interference suppression scenario where the 
unknown matrix for each time instant is given by H(i) = 
{l/^/W c )A k I c FM- To fulfill the interference suppression task, 
an MMSE filter W(i) £ C MxN can be developed via the 
following cost function: 

J MSE (i)=E{ b(i) - F%W H (i)z(i) 2 }. (16) 



The MMSE solution is given by EQ 
Wmmse = VI C 



(17) 



wXki^ ij - x " + ^) 



(18) 



where Im £ C denotes the identity matrix. Note that the 

matrix V consists of N c times N c diagonal matrices Vjj £ 
<C NxN , where i,j £ {1, N c }. Hence, we take a closer look at 
the product of V and I c : 



VI e 





"V x ,i 


Vi, 2 .. 


• v hNc ' 




'In 


, = 


V 2 ,i 


V 2a ■■ 


V2,N C 




In 




_VN e ,i 


Vn c ,2 ■ ■ 


Vn C! n c _ 




In 






'W"i 


W 2 




=1 V N c ,j_ 








w Nc 





\In 




In 




Jn_ 



= wi c , 



where W i = E 7 =i Viji « = 1, • • • , N c , are diagonal matri- 
ces. Hence, the product of V and J e can be converted into a 
product of a diagonal matrix W £ C M x M ( M = N x N c ) and 
J e , where the diagonal entries of W are Wi, I = 1, .. . , M, 
and equal the sum of all entries in the Z-th row of matrix V. 
Finally, we express the MMSE design as 

Wmmse = WI C = diag(™ c )J c , (19) 

where w c = (wi,W2, ■ ■ ■ , wm) is an equivalent filter with M 
taps. 

The expression shown in ( fT9l enables us to design an M- 
dimensional receive filter rather than an M-by-7V matrix form 
receive filter. The estimated data vector can be expressed as 



b(i) 



rpH T H 
b N J c 



W H {i)z{i) 



F*I?Z(f)ib(i), (20) 



where Z(i) = diag(z(«)) and w(i) — w*(i) is the weight 
vector of the adaptive receiver. Since Fn and I c are fixed, 
we consider the equivalent N-by-M received data matrix as 



Y(i) = F N I C Z(i), and express the estimated data vector as 
(14) b(i) =Y(i)w(i). 



D. LS solution and adaptive RLS algorithm for the interfer- 
ence suppression scenario 

Here, we detail the LS and RLS designs for the frequency 
domain multiuser receiver w. The cost function for the devel- 
opment of the LS estimation is given by 

J LS = \\b-Yw\\ 2 . (21) 

The LS design of the linear receiver can be expressed as 

w LS = (Y H Y)- 1 Y H b = RlsVls, t 22 ) 

where the matrix J?ls is defined as Y Y and p LS represents 
the vector Y b. Note that, the data vector can be expressed 

as 



b = Yw 



O i c O; 



(23) 



where e is the measurement error vector and w is the 
optimum tap-weight vector of the receiver (optimum in the 



with only one shrinkage factor. In [22], the proposed scaled LS 

channel estimator can be considered as a biased estimator with 

only one shrinkage factor, which outperforms the conventional 

LS estimator while it requires a much lower complexity 

o N ff than the MMSE estimator. The basic idea of the following 

E\ \\w — ii?lS [ = E](u; — ii>ls) (w —wls)\ = var(w ,WTs). , , , , . , .. . , rcc , . , ^ , 

Ul ° °" J LV a ' y °' J y ' 'proposed group-based shrinkage estimator (GSE) is to find a 



MSE sense). Assuming that e is white and Gaussian with 
zero mean and covariance of cr^I n, then the LS solution in 
d22l is a MVUE [27]. Now, let us have a look at the following 
MSE: 



Defining v w = var(w , ujlsX we nave 13 

w t0 =irK 2 (r H F)- 1 }, (25) 

where <r 2 is the variance of the measurement error. 

In the interference suppression scenario, it is possible to 
introduce the biased estimation to reduce the MSE between 
the optimal receive filter w and the LS estimator i^ls- Note 
that, for the interference suppression scenario, the typical 
objective is to minimize the overall performance criterion 
which is determined as E{||6— b|| 2 }, rather than to minimize 
E{||ti> — w || 2 }. The main motivation to introduce the bias in 
the interference suppression scenario is to provide an initial 
improvement for the overall performance when the adaptive 
filtering techniques are employed and the training data are 
limited. This can also help with tracking problems and with 
robustness against interference. 

The LS solution of the receiver can be computed recursively 
by the RLS adaptive algorithm. We employ the RLS update 
equation that is proposed in [21] 



'"'RLS^ + l) = WKLs(i) + R v , (i)Y (i)e aw (j) 



(26) 



where R w (i) = £} =1 X^Y H (j)Y(j) and e avj (i) = b(i) - 
Y(i)w(i). Note that R w (i) is an M-by-M symmetric sparse 
matrix in which the number of nonzero elements equals 
MN C . Hence, the complexity of each adaptation by using this 
algorithm is O(MN^). 

III. Proposed GSE for parameter estimation 

SCENARIO 

A. Proposed GSE: Optimal Solution 

It is known that the biased estimator with a shrinkage factor 
can be expressed as 

/i b = (l + a)h LS , 



(27) 



where /ils G 
and /i b € 



'Lxl 



i£xl 



is the LS estimator of the parameter vector 
is the biased estimator with a shrinkage factor, 



a is a real-valued variable and (1 + a) is defined as the real- 
valued shrinkage factor that is larger than but smaller than 
1 (i.e., -1 < a < 0). 

Actually, for the parameter estimation scenario, the MMSE 
estimators with the following expression can also be consid- 
ered as a biased estimator, 



/iMMSE 
C Lxl 



Ah hs , 

A e C LxL 



(28) 



where /immse € C jLxi and A e <C LXL is a full-rank 
matrix. As in [22| and |23|, such MMSE channel estimators 
are developed for MIMO and OFDM systems, respectively. 
Although these MMSE estimators can achieve a much lower 
MSE than the LS estimator especially in low SNR regime, they 
experience much higher complexity than the biased estimator 



solution with a better tradeoff between the complexity and 
the performance than the MMSE estimator and the biased 
estimator with only one shrinkage factor. 

The proposed GSE can be expressed as follows: 

(l + «i)ftLs(l) 



(1 + C*1>LS(§) 

(l + a 2 )/iLs(| + l) 



h h = 



(1 



« 2 )ft LS (f) 



(l + a s )h LS ( 



(S-1)L 

s 



1) 



(l + a s )h hS (L) 



= H LS (l s + a) (29) 



where Hls <= 



■^LxS 



is a block diagonal matrix that is 



constructed from the elements of h^s as well as zeros, S is 
the number of groups, we define the S'-dimensional column 
vectors Is = [1, 1, ... , 1] T and a. = [ai,ce2, • ■ • , Qs] T . The 
scalar a s is a real-valued variable and (1 + a s ) is defined as 
the shrinkage factor for the s-th group of coefficients that is 
larger than but smaller than 1, where $ = 1, 2, . . . , S. Here 
we propose to use a uniform group size for the i-dimensional 
parameter vector, hence the size of each group is L/S. If the 
length of the parameter vector divided by the group size is 
not an integer, we can perform zero-padding in the parameter 
estimation vector to fulfill this requirement. If any statistical 
knowledge of the parameter vector is given, the group size 
could be different from each other. But this approach will 
introduce a higher complexity because we need to select the 
size of each group and choose a suitable one. In this work, 
for notational simplicity, we will focus on the low complexity 
uniform group size approach. 

The goal is to minimize the MSE defined by 



E{||h- 



-M 2 } 



E{(h b -E{h b }) if (h b -E{h b })}- 



Note that 

h b -E{h h } = (H hS -H)(l s 
and we have if ls = H + N where 



a) 



\E{h h }-h\\ 
(30) 

(31) 



N 



hx 



n 2 







n s 



(32) 



Lxl 



and n = (X"X)- 1 X H n = [n x ,n 2 , ■ ■ ■ , n s ] e C 
assuming that all the elements in this equivalent noise vector 



are independent and identically distributed (i.i.d.) random 
variables. Hence, we have 

E{(h b -E{h b }) H (h h -E{h b })}=a 2 (l s + a) H (ls + a) 

(33) 
Note that a 2 equals the variance of the equivalent noise h 
times the length of the group. We also have 

\\E{h b }-h\\ 2 = a H H H Ha 



Finally, the optimal solution of the vector a that minimizes 
(f30b is given by 



Htt\- 1 - I 



a opt ^-d 2 (a 2 I s + H H H) l s . 



and we have 



h 



b,opt 



Hi,s(ls + "opt) 



(35) 



(36) 



Note that this equation is a general expression for different 
numbers of groups. The complexity of this algorithm is very 
low because the inverse matrix required to calculate the a opt 
is a diagonal matrix. Hence, this estimator combined with the 
conventional RLS algorithm will only introduce an additional 
complexity that is linear in the length of the parameter vector 
L and the number of groups S. If the group size equals L, 
then the GSE converges to the biased estimator with only one 
shrinkage factor. In the following section, adaptive algorithms 
will be developed to compute the best GSE with a given group 
size. 

B. Proposed GSE: Adaptive Algorithms 

It should be noted that the optimal solution of the biased 
estimator requires some prior knowledge of the system, which 
is the matrix H H and the scalar term a 2 for calculation 
of the vector a. In addition, the LS channel estimator is 
also required. The LS channel estimator can be recursively 
calculated by the RLS adaptive algorithm that is detailed in 
Section IH-BI In this work, we propose LMS-based adaptive 
algorithms that enable us to estimate the vector a. without prior 
knowledge of the channel and the noise variance. Substituting 
(l34l l and (l33l into (f30b and considering the MSE cost function 
as a function of a, we can obtain a new cost function 

f(a) = a 2 {l s + a) H (l s + a) + a H H H Ha. (37) 

The gradient of f(a) with respect to a is given by 

g a = a 2 {l s + a)+H H Ha. (38) 

Note that, because a is a real-valued vector, there is a factor 
of 2 for this gradient. In what follows, this factor is absorbed 
into the step size of gradient- type recursions. Hence, the LMS- 
based update equation of the vector a. for the (i + l)-th time 
slot can be expressed as 



a(i + l) = a(i) - p,g a (i), 



(39) 



where /i is the step size of the LMS algorithm and the 
estimated gradient vector is given by 



Here, a 2 (i) is the estimated equivalent noise variance and 
the diagonal matrix P m (i) is defined as the estimator of 
the matrix H H, the main diagonal vector of this matrix 
is defined as diag[P m (i)] = [P m ,x(i), . . . ,P m ,s(i)] ■ In 
this work, we adopt the instantaneous estimator as a 2 {i) = 
||^RLs(i) — h(i)\\ 2 /S, where /irls(*) is the RLS channel 
estimator and h(i) = 4 X^-=i ^RX,S (J) represent the time 



H ■ 



(34) averaged channel estimator. Note that H H G 



■*SxS 



diagonal matrix with its s-th diagonal element equals h^. s = 

z2i=(s~i)l/s+i IM')I ■ 

Hence, the elements in the optimal solution can be expressed 
as a pt,s = —(1 + h^^/a 2 )^ 1 . If we use the matrix P m {i) 
to replace the matrix H H, the estimated optimal solution 
becomes 



^opt,s 



a 2 



o" 2 + P m ,s{i) 



(41) 



Recall that we assume that the shrinkage factors for each group 
are larger than zero but smaller than one. It can be found that 
if Pm,s{i) < 0, this assumption no longer holds. In addition, if 
Pm,s{i) — > oo, the shrinkage factor converges to zero, and the 
biased estimator actually converges to the unbiased estimator. 
So we should constrain the values of P m>s (i) into the range 
(0,+oo). 

In order to determine the diagonal matrices P m {i) for each 
time instant, two approaches are developed in this work. In 
the first approach, which is named estimator based (GSE-EB) 
method, the matrices P m {i) are replaced by the diagonal ma- 
trices .H~ RLg (i).H~RLs(*X where £Trls(*) is me RLS estimator 
of H. Note that, when the number of groups is only one, the 
GSE-EB method will lead to an optimal shrinkage factor a 
that has the same expression as the SBME that is proposed 
in |16|. However, the knowledge of the noise variance is not 
required in our work. In the second approach, which is named 
automatic tuning (GSE-AT) method, an LMS-based algorithm 
is proposed to update the diagonal matrices P m (i). 

For the GSE-EB method, the estimation of P m {i) is only 
determined by the RLS estimator. If the effective spreading 
codes and the channel information is known, the RLS al- 
gorithm can be initialized efficiently. Here, we consider a 
general scenario where all these quantities are unknown and 
the initialization of the RLS algorithm is an all zero vector, 
which means the beginning stage of the RLS algorithm is not 
very accurate. In order to improve the convergence rate of 
the proposed GSE schemes, we develop the following GSE- 
AT algorithm. For each time instant, P m (i) is firstly set 
to -ff RLg (i).H r Fjj J s(i) as in the GSE-EB algorithm, then we 
consider P m ,s{i) as the variables of the MSE cost function, 
where P m . s (i) are the diagonal elements of the diagonal 
matrix P m (i) and s = 1, 2, . . . , S. Then we develop an LMS 
adaptive recursion to further adapt these values and improve 
the estimation accuracy for each time instant. Let us reexpress 
the MSE cost function as shown in < f30l > as follows. Here, we 
omit the time index i for simplicity 

f{P m ) = & 2 (l s + a) H (l s + a)+ a H P m a, (42) 



g a (i) = a 2 (i)(l s + 6(0) + P m (i)a(i). 



(40) where a = -a 1 (a 2 I s + P 



I5 is also a function of P r , 



Expanding this cost function, we have 



f([P m , 1 ,...,P mt s]) = a 2 J2(l + a s ) 2 + ^2a 2 3 P m , s . (43) 



s=l 



8=1 



■*m,s(£~r J-J ± m,8\C) ^p9s7 



(44) 



where c is the iteration index and g s is the estimator of the 
gradient of the function (l43l with respect to P m . s , which is 
given by 



g s = 2d 2 (l+a s )- 



ZOCs-Lfr 



STfj 



l 7r 



(45) 

In order to obtain a low complexity solution, for the GSE- 
AT algorithm, we set the iteration index c to 1, which means 
for each time instant we only update the values of P m , s once. 
As pointed out previously, the values of P m (i) should be 
constrained in the range (0, +oo). Hence, for the GSE-AT 
algorithm, if the updated values are negative, then we set these 
values to the same values of GSE-EB algorithm. In Table [I] the 
proposed biased estimators using two approaches to calculate 
P m (i) are summarized. 

Note that the GSE-EB approach (where P m (*) = 

-^rls(*)-^RLs(*)) requires 227 + 35 + 2 complex multipli- 
cations and 3L + 5 complex additions for one update of the 
shrinkage factors. For the GSE-AT approach, in which P m (i) 
is updated by using equation d44b . the number of complex 
multiplications required to update the shrinkage factor is 
2L + 135 + 2 and the number of complex additions required 
is 3L + 75. It will be demonstrated by the simulations that 
the performance of the GSE-AT approach is better than the 
GSE-EB approach, while the GSE-EB approach has a lower 
complexity. 



IV. Proposed GSE for interference suppression 

SCENARIO 



where u>ls G C Mxl is the LS estimator of the receive filter. 
The proposed GSE can be expressed as follows: 

(1 + a 10 ,i)w>Ls(l) 



Hence, for each group, the corresponding P m ,s can be obtained 

by the following equation ^b = 



(1 + a t0 ,i)w)Ls(§) 
(l + a™, 2 )u<Ls(§ + l) 



(1 + CV 2 )u>ls(^) 



(l + a w , s )w LS {^^ + l) 



(1 + a w ^ s )w hS (L) 



= W LS (l s + a w ) 



where V^ls € 



iMxS 



(47) 
is a block diagonal matrix that is con- 
structed by the elements from w-^s and zeros, 5 is the number 
of groups. Moreover, we define the 5-dimensional column vec- 
tors l s = [1,1,..., 1] T and a w = [oku,i,a w ,2, ■ ■ ■ ,a w ,s] T - 
The quantities a w>s are real-valued variables and (1 + a w>s ) 
is defined as the shrinkage factor for the s-th group of 
coefficients that is larger than zero but smaller than one, where 
5=1,2,.. .,5. 

The objective of the GSE is to achieve a smaller MSE than 
the LS algorithm, which can be expressed as 



E[||™ -™ b || 2 ]<E[||™ -u; L s|| 2 ]. 



(48) 



It should be noted that the problem that we want to solve 
for both parameter estimation and interference suppression 
scenarios has a similar form. Hence, we can follow the 
derivation as shown in Section IIII-AI and the optimal solution 
of the parameter vector a w is given by 



K u;,opt 



~2 I ~2 

-cr„Aa,„. 



W H W) 



(49) 



where W = E[Wls]> &w = V w/S and we have 

&b,o P t = Wls(1s + avopt) (50) 

B. Proposed GSE: Adaptive Algorithms 

In this section, the LMS-based adaptive algorithms are 
proposed to estimate the vector a w . First, we consider the 
MSE cost function as a function of a,,„ i.e., 



f(oc w ) 



dl 



(If 



)*(1* 



■i)+a. 



■, H W H Wa. 



(51) 



The gradient of f(a w ) with respect to a^ is given by g w = 
dl, (l s + a w ) + W H Wa w . Hence, the LMS-based update 
equation of the vector ot w for the (i + l)-th time slot can be 
expressed as 



a w (i + 1) = a w (i) - ft w g w (i), 



(52) 



A. Proposed GSE: Optimal Solution 

where \x w is the step size of the LMS algorithm and the 
For the interference suppression scenario, the biased esti- estimated gradient vector is given by 



mator with a shrinkage factor is given by ifPTl 

w h = (l + a)w L $. 



9 w (i) = &w(i)0-s + ot w (i)) + P w (i)a w (i), (53) 

where a%,(i) is the estimated equivalent noise variance and the 
(46) diagonal matrix P w (i) € C SxS is defined as the estimator of 



TABLE I 

GSE for SCE-RLS in SC-FDE DS-UWB Systems 



Proposed GSE-EB 


Proposed GSE-AT 


1. Initialization: 

a(l) =0 6 C Sxl 
Set value of /i 


1. Initialization: 

a(i) = oec Sxl 

Set values of /i and n P 


2. Calculate the biased estimator: 

For i = 1,2, ... 

h h (i) =H RLS (i)(l,s+a!(i)) 


2. Calculate the biased estimator: 

For i= 1,2, ... 

h h (i) = H nhs (i)(ls + &(i)) 


3. Calculate the shrinkage factor: 

^) = iEi=ihRLs(i) 

v 2 (i) = \\h^ s (i)-h(t)\f/S 
P m (i) = H" LS (i)H RIjS (i) 

g a (i) = a 2 (i)(l s + &(i)) + P m (i)&(i), 
&(i + l) =&(i) -fig a (i). 


3. Calculate the shrinkage factor: 

^(i) = \\h RL s(i)-h(i)\\ 2 /S 

Pm(i) = H" LS (i)H RLS (i) 

For s = 1, 2, . . . , S 

P m ,s(i) = P m ,s(i) - n P g s (i), where g s (i) is given in {45). 

If Pm |S (i) < 0, set P m (i) = -HrlsOO-Hrls^) break; 

End For. 

g a (i) = a 2 (i)(l s + &(i)) + P m (i)a(i), 

&(i + l) =6c(i) -ixg a {i). 



the matrix W W, the main diagonal vector of this matrix is 
defined as diag[P lu (i)] = [P w> i(i), . . . , Pw,s(i)]- The instan- 
taneous estimator of <T^(i) is given by cr^,(i) = (wrlsW — 
w (i)) (tt>RLs(*) — w o(i)), where w is replaced by the time 
averaged RLS estimator, that is w (i) = i X^=i ^Rhs(j)- 

In order to determine the diagonal matrices P w (i) for each 
time instant, the GSE-EB method and the GSE-AT method 
are developed in the interference suppression scenario. In the 
GSE-EB approach, the matrices P w (i) are replaced by the 

diagonal matrices W^rls(*)^R.ls W- However, because we 
assume that the initialization of the RLS algorithm is an all 
zero vector, the beginning stage of the RLS algorithm is not 
very accurate. Hence, in order to improve the convergence 
rate of the proposed GSE schemes, we develop the GSE- 
AT algorithm. For each time instant, the matrix P w (i) is 

firstly set to WrlsW^klsOO as m the GSE-EB algorithm, 
then we consider P WyS (i) as the variables of the MSE cost 
function, where P WiS (i) are the diagonal elements of the 
diagonal matrix P w (i) and s — 1, 2, . . . , S. Then we develop 
an LMS adaptive equation to further adapt these values and 
improve the estimation accuracy for each time instant. Here, 
we omit the time index i for simplicity and have 



f([Pw,i,---,Pw,s}) =5%y^ (l + a w>s 



s 

■E 

s=l 



rt 1 P 



(54) 
Hence, for each group, the corresponding P ws can be updated 
by the following equation 



P w ,s( c + !) = Pw,s(c) - fJ-s 



(55) 



where c is the iteration index and g w , s is the estimator of the 
gradient of the cost function with respect to P m , 8 , which is 
given by 

^•2 



2o" i (l+d s 



a 2 



'° 2 + P„ 



r+2a s P„ 



Pn 



In order to obtain a low complexity solution, we set the 
iteration index c to 1 for the GSE-AT algorithm. Note that if 
the updated values in the GSE-AT algorithm become negative, 
then we set these values to the same as obtained in the GSE- 
EB algorithm. In Table [II] the proposed biased estimators with 
two approaches to calculate P w (i) are summarized. 

Note that the GSE-EB approach (where P w (i) — 

^rlsM^RLs(*))' requires 2M + 35 + 2 complex multipli- 
cations and 3M + S complex additions for one update of the 
shrinkage factors. For the GSE-AT approach, in which P w (i) 
is updated by using equation (l55l l. the number of complex 
multiplications required to update the shrinkage factor is 
2M + 135+ 2 and the number of complex additions required 
is 3M + 75. It will be demonstrated by the simulations that 
the performance of the GSE-AT approach is better than the 
GSE-EB approach, while the GSE-EB approach has a lower 
complexity. 

V. MSE Analysis 
In this section, we will analyze the MSE performance 
of the proposed GSE. Since the proposed GSE has similar 
forms in the parameter estimation scenario and the interference 
suppression scenario, we carried out the following derivations 
based on the parameter estimation scenario. Firstly, we will 
prove that the minimum MSE obtained by the GSE schemes 
will always be smaller or equal to the MSE that can be 
achieved by minimum variance unbiased estimator (MVUE) 
such as the LS estimator. Then the MSE lower bounds of the 
GSE schemes will be derived. In addition, we will prove that 
when the numbers of groups is larger than or equal to two, 
the MSE lower bound will always be lower than the biased 
estimator with only one shrinkage factor (when the number of 
groups 5 equals one). 

A. MMSE Comparison 

Assuming AWGN with zero mean and variance a^, the LS 
(56) estimator is a minimum variance unbiased estimator. The MSE 



r+a;. 



TABLE II 

GSE for Frequency domain receiver in SC-FDE DS-UWB Systems 



Proposed CiSfc-bB 


Proposed CiSh-Al 


1. Initialization: 

a w (l) = oec Sxl 

Set value of /i w 


1. Initialization: 

a w {l) = oec Sxl 

Set values of fi w and /i s 


2. Calculate the biased estimator: 

For i = 1,2, ... 

w b (i) = W RLS (i)(l5 + &w(i)) 


2. Calculate the biased estimator: 

For i = 1,2, ... 

w b (i) = V^ RLS (i)(ls + a w (i)) 


3. Calculate the shrinkage factor: 

™(i) = 7£j- = i™RLsO') 

a 2 w (i) = II-ujrlsOO - ™(i)\\ 2 /S 

9 w (i) = ff»(i)(ls + «»(')) + P w (i)oL w (i), 
a m (i + 1) = a»(i) - Hw9 w {i)- 


3. Calculate the shrinkage factor: 

™M = jT,) = i™RLs{j) 

5-2 (i) = \\w KLS (i) - w(i)\\ 2 /S 

P w (i) = w" hS (i)W RLS (i) 

For s = 1, 2, . . . , 5 

Pw,s{i) = Pw,s{i) — fJ, 3 gw,s{i), where g w , s (i) is given in {56}. 

If P w , a (i) < 0, set P w ({) = W RLS (i)W RLS (i) break; 

End For. 

9 w (i) = 5iW(ls + &w(i)) + P w (i)a w (i), 

a w (i + 1) = a. w (i) - fj, w g w (i). 



for the LS estimator is 

E{\\h- h LS \\ 2 } = E{(h LS - h) H (h LS - h)} = var(h, h LS ). 

(57) 
Defining v — var(h, /ils)> we have 



tr{al(X H X)- 1 } 



(58) 



It should be noted that we can also express the LS estimator 
as /ils = h + n, hence, we have that the variance of the 
elements in the equivalent noise h is d\ = v/L. 

Recall that the target of the biased estimation that is to 
reduce the MSE introduced by h-^g. The objective is to obtain 
a biased estimator that results in 



E{\\h-h h \\ 2 }<E{\\h-h LS \\ 2 }. 



(59) 



Recall the equations d33l > and d34l >. the objective becomes 



a 2 (l s + a) H (l s + a) 



a H H H Ha < v. 



(60) 



Since 5% = v/L, we have a 2 — (L/S)a 2 i — v/S. In appendix 
lAl we prove that this objective is always fulfilled with the 
optimal solution a op t as shown in ( 1351 ). 

B. MSE Lower Bound and the Effect of the Number of Groups 

It should be noted that a lower bound of the MSE perfor- 
mance of the proposed GSE schemes that corresponds to the 
optimal a can be obtained as 



E{||fc - h h \\ 2 } >(S + J2 «o P t,s)| = v - — ==L 

S— 1 

S v 2 



v+h^ 



l) 



s 



s—1 



hy^S 2 ' 



(61) 



Since the second term on the right hand-side is non-negative, 
it can be concluded that the MSE lower bound will always 
be smaller than or equal to the unbiased Cramer-Rao Lower 



Bound (CRLB), which is expressed as v in this equation. 
Note that this expression can be considered as the relationship 
between the MSE lower bound of the GSE and the unbiased 
CRLB. In the case where the number of groups equals 1, we 
have S = 1, <r 2 = v and a opt — —v/(v + \\h\\ 2 ). The lower 
bound becomes 



H\\h-h h f}> 



l + v/\\h\\ 



(62) 



In this case, the one-group GSE scheme converges to our 
previously proposed shrinkage factor biased estimator IfPJI . 

ffH. 

For the proposed GSE schemes, we prove the following 
statements: 

Statement 1: The MSE lower bound as shown in d6"TT l with 
S > 1 will always be lower than or equal to the lower 
bound for 5=1. This statement indicates that our proposed 
GSE outperforms the biased estimator with only one shrinkage 
factor. The proof is detailed in appendix [B] 
Statement 2: The lowest MSE lower bound as shown in (loTT i 
can be obtained in S = L case, where L is the length of 
the parameter vector to be estimated. This statement indicates 
that the optimal performance can be obtained with the largest 
possible group number. The proof is detailed in Appendix |B] 

The performance of the algorithm depends on the number 
of groups and the scenario. If some a priori knowledge of the 
parameter vector to be estimated is available, then a possible 
extension of the GSE is to develop a method to determine the 
size of the groups. For example, the knowledge of the expected 
value of the number of clusters of a UWB channel might 
enable a more attractive tradeoff between the performance and 
the complexity. Moreover, the increase in the number of groups 
can improve the MSE performance. However, this comes 
with diminishing returns and an increase in the computational 
complexity. 



10 



VI. Simulations 

In this section, the proposed GSE estimators are employed 
in the SCE and in the design of the frequency domain re- 
ceiver of a synchronous downlink block-by-block transmission 
binary phase shift keying (BPSK) DS-UWB system that are 
detailed in Section IH-BI and Section III-C1 respectively. Their 
MSE performances are compared with the conventional RLS 
adaptive algorithms. The pulse shape adopted is the root- 
raised-cosine (RRC) pulse with the pulse-width T c = 0.375 
ns. The length of the data block is set to N = 32 symbols. 
The Walsh spreading code with a spreading gain N c = 8 
is generated for the simulations and we assume that the 
maximum number of active users is 7. The channel has been 
simulated according to the standard IEEE 802.15.4a channel 
model for the NLOS indoor environment as shown in [25 1. 
We assume that the channel is constant during the whole 
transmission and the time domain channel impulse response 
has 100 taps. The CP guard interval has a length of 35 
chips, which has the equivalent length of 105 samples and 
it is enough to eliminate the IBI. The uncoded data rate 
of the transmission is approximately 293 Mbps. For all the 
simulations, the adaptive receivers/estimators are initialized as 
null vectors. All the curves are obtained by averaging 200 
channel realizations. In Fig. [2]- Fig. [5] the performance of the 
proposed GSE in the parameter estimation scenario (SCE as 
an example) is shown. In this scenario, the GSE is employed 
to improve the MSE performance of the channel estimation. 
In Fig. [6] to Fig. [HJ the performance of the proposed GSE 
in the interference suppression scenario (frequency domain 
receiver design as an example) is presented. In this scenario, 
the GSE schemes accelerate the convergence speed of the 
adaptive algorithm. 
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Fig. 3. MSE lower bounds for the proposed GSE with different numbers of 
groups (SCE). 
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Fig. 2. Surface of the MSE difference in a scenario with S = 2 (SCE). The 



First, we examine the MSE difference between the unbiased 
estimator and the proposed GSE as a function of the shrinkage 
factors for each group in a single user system with dB 
SNR. In Fig. pi the surface defined as (5MSE = \\h - 
/ib|| 2 — \\h — /irls|| 2 m me range of the shrinkage factors 
between to 1 is shown. Note that, when the bias equals 



Fig. 4. MSE performance with different numbers of groups (SCE). Param- 
eters used: RLS: A = 0.998, <5 = 10. Proposed GSE EB: (j, = 0.075. 



zero, which corresponding to the point [1, 1] in the figure, the 
MSE difference equals zero. The optimal solution is located 
at [1 + a%, 1 4- OL2] = [0.15, 0.35]. For this channel realization, 
the optimal solution that is obtained by our algorithm after 
transmitting 1000 data blocks is reported as [1 + di, I + CK2] = 
[0.16, 0.35], which is very close to the optimal solution shown 
in this figure. 

In Fig. [3] the MSE lower bounds for the proposed GSE 
schemes with different numbers of groups are shown as a 
function of SNR. The proposed biased estimators show a better 
performance than the conventional unbiased estimator. As we 
have proved, the best performance can be obtained in case 
of S = L, The proposed GSE schemes can maintain the 
MSE gain for low and medium SNR regimes. In high SNR 
scenarios with a small noise variance, the biased estimator 
converges to the unbiased estimator and the gain becomes 
smaller. Compared with the biased estimators with only one 
shrinkage factor (which is equivalent to the case S = 1), the 
GSE schemes with a number of groups can maintain the MSE 
gain until higher SNR regime. 

In the third experiment, we examine the proposed GSE 
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Fig. 5. MSE performance of the proposed GSE-EB and GSE-AT algorithms 
with 5 = 1 and S = L (SCE). Parameters used: Proposed GSE-EB: fi = 
0.075. Proposed GSE-AT: fj, = 0.075, fip = 0.05. 
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Fig. 7. Normalized MSE performance (||6 — b\\ /||6|| ) of the biased 
estimators with 5 users in 3 dB SNR. 
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Fig. 6. Normalized MSE performance (||6 - £>|| 2 /||£>|| 2 ) of the biased suppression scenario with 5 users, 
estimator with 5 users in 5 dB SNR. 



Fig. 8. Coded BER performance of the GSE schemes in interference 



schemes with different numbers of groups for the SCE in 
a single-user system with dB SNR. In Fig. 0J the MSE 
performance of the channel estimators are compared as a 
function of the number of blocks transmitted. The RLS al- 
gorithm approaches the unbiased CRLB while the proposed 
biased estimators approach the lower bounds as given in (loTV 
The biased estimators converge faster than the RLS algorithm 
and the steady-state performance is also improved. Note that 
the additional complexity to employ the proposed biased 
estimation techniques increases linearly with the product of 
the number of groups and the length of the channel. 

In Fig. [5] the proposed GSE-EB and GSE-AT algorithms 
are compared in S = 1 and S — L scenarios in a single 
user system with dB SNR. It can be found that the GSE- 
AT algorithm can provide a noticeable gain over the GSE-EB 
algorithm especially at the beginning stage of transmission. 
This is because the GSE-AT algorithm allows us to further 
adjust the diagonal matrix P m (i) for each time instant. At 



the beginning stage when the RLS algorithm does not very 
accurately estimate the channel, the GSE-AT algorithm can 
be used to improve the convergence rate. 

In Fig. |6l the performance of the proposed GSE is shown 
in the interference suppression scenario (frequency domain 
receiver design as an example) with a short training sequence. 
In this simulation, 50 training blocks are transmitted in a 
scenario with 5 users with 5 dB SNR. The proposed GSE- 
EB algorithm outperforms the RLS algorithm and the best 
performance is obtained by setting S — M. In Fig. [7] 
we compare the GSE-EB and GSE-AT algorithms in 5-user 
communications and an SNR of 3 dB. In this experiment, 
150 training blocks are transmitted. The GSE-AT algorithm 
can further accelerate the convergence rate of the GSE-EB 
algorithm. At the beginning stage, the GSE-AT algorithm 
introduces the best performance. 

In Fig. [U the bit error rate (BER) performance of the 
proposed GSE with different numbers of groups are shown 
in a scenario with 5 users. The coded BER performance is 
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obtained by adopting a convolutional code and an LDPC code 
[30 1 designed according to the PEG approach [30 1 . For the 
convolutional code, the constraint length is 5, the rate is 2/3 
and the code polynomial is [7,5,5]. For the LDPC code, the 
rate is 1/2 and the code length is 200 bits. The maximum 
number of iterations is set to 20. In this experiment, 100 
training blocks are transmitted followed by 400 data blocks. 
With the convolutional code, the proposed GSEs perform 
better than the RLS algorithm and the maximum gains are 
obtained in the medium SNR range from 12 dB to 17 dB. 
By employing the LDPC code, a BER of around 10~ 3 is 
achieved at 12 dB. The proposed GSEs with LDPC codes 
also outperform the RLS algorithm and the maximum gains 
are obtained for an SNR around 7 dB. 

VII. Conclusions 

In this work, a novel biased estimation algorithm called 
group-based shrinkage estimator (GSE) is proposed, which 
divides the target parameter vector into a number of groups 
and calculates one shrinkage factor for each group. Adaptive 
algorithms are developed for the GSE scheme in the parameter 
estimation and the interference suppression scenarios. The 
incorporation of the proposed estimators has been consid- 
ered in the frequency-domain of DS-UWB systems, where 
structured channel estimation and the receiver designs are 
considered as examples of the parameter estimation scenario 
and interference suppression scenario, respectively. An MSE 
analysis is presented that indicates the lower bound of the 
proposed GSE schemes. The relationship between the lower 
bound and the number of groups are also established. It 
has been proved that the GSE provides a better performance 
than the biased estimators with only one shrinkage factor. In 
addition, the lowest MSE lower bound can be obtained in 
the S = L case. As for future research directions, the GSE 
scheme can be developed in different systems and scenarios. 
In addition, if we have some prior knowledge of the target 
parameter vector, we can then divide it into groups with 
different sizes and find more attractive tradeoffs between the 
computational complexity and the performance. 

Appendix A 
MMSE Comparison 

In order to check if the objective as shown in (l60t is 
fulfilled with a opt , the equation d35l > is rearranged by taking 
the expression of the diagonal matrix H H <G C SxS into 
account. We have 



cc H H H H a = Y,o? opt M,s 



(65) 



By substituting d64b and d65l l into the MSE expression ( f60b 
and bearing in mind that Sir 2 = v, the inequality that we want 
to prove becomes 

s s 

a 2 2(1 + a opt , s ) 2 + 2 a? opt ,M,s - Sa 2 < 0. (66) 

s=l s=l 

Note that the left hand-side of d66l l can be expressed as 



E 



<%., 



opt,s 

S=l 8=1 

S 



2 2a pt )S + 2 a o P t>£ :S /o- 2 



(67) 



= E a o P t,s(l + h^s/v 2 ) + 2 2a °PM- 

s=l s=l 

By recalling that a op t. s = —(1 + h^.s/cr 2 )^ 1 is always a 
non-positive scalar value, the left-hand side of the equation 
becomes 

s s s 

^2(1 + h^ s /d 2 y l + ^ 2a op t,s = 2 a °pt> s - < 68 ) 

s— 1 s— 1 s — 1 

As a pt,s are always non-positive, the summation on the right 
hand-side of d68l l will always be smaller or equal to zero, 
which completes the proof. 

Appendix B 
Proofs of the statements 

First, we want to prove that the lower bound of MSE as 
shown in doTT l with 5 > 1 will always be lower than or equal 
to the 5 = 1 case. Based on the equation doTT l. we can focus 
on the following function 



f(s) = E 



i s i 

C2 Z^ (i,/Q) > 



'Sv + hx,sS 2 S 2 ^(v/S) + h^ 

1 s— 1 v ' ' 



(69) 



where hs,s = J2i=( s -i)L/s+i IM*)I 2 The task now is equiv- 
alent to proving that f(S) > /(l) for all the possible values 
of S. Note that ]Tf =1 hs, s = \\h\\ 2 and 

/a) ' " ' 



^+ll^l| 2 W + Ef-^E,. Z s -l(v/S + hj;, a ) 

(70) 
Hence, the relation becomes 



E 



i 



> 



s 2 



(71) 



a op t = [a opt ,i, . . . , a op t : s] T = -a 2 (a 2 1 + H H) l s 

= -[(1 + h^/d 2 )-\ (1 + h s , 2 /a 2 )-\ . . . , (1 + h^s/vTY 

(63) 

where h, s , s = J2l=is-i)L/S+i IMOI 2 - Hence, we have the 
following expressions 



^(v/s)+h^ s -j: s s=1 (v/s+h^ s ) 

Actually, we can express this problem as the following math 
ematical problem: 

11 IS 2 

— + — + ••• + —> — 
ai a 2 



(72) 



& 2 {l s + a) H {l s + a) = a 2 ^(1 + a opt , s ) 2 , (64) 



a * e:=i 0. 

where S is a positive integer and a s = (v/S) + h^ :S are all 
non-negative values. This inequality can be proved by using 
the mathematical induction as follows: 

For 5=1, the left-hand side and the right-hand side are both 
equal to — , 
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For S = 2, the left-hand side equals — + — = ^^^ and 

^ ai a2 aio,2 

the right-hand side equals ^_ a . Since (ai +a2) 2 — 4ai<22 = 

(ai — g^) 2 > 0, the inequality holds. 

Assuming the inequality holds for S = n, where n > 2, we 

have 



1 1 



1 



> 



n 



(73) 



1 — Y^ n 

(*n Z_-/s— 1 ^ s 

For 5 = n + 1, we first consider the left-hand side as follows 



1 1 

a\ a 2 



1 



1 



> 



n 



1 



O-n CLn+1 



En 
8=1 



a s a„+i 



2 , v^n 

_ n Qn+l + L s =l fl s 

(2s=l a s) ' a "+l 

and then, the right-hand side is given by 

(n + 1) 2 

En . 

8=1 a s + Ori+1 



(74) 



(75) 



Because 

n n n 

( X! ° s + a »+i) (" 2a »+i + X! ° s ) ~ ( n + - 1 ) 2 ( X! as ) ■ a " +i 



8=1 



= (^2 a s -Tl-On+l) > 0, 

8 = 1 

the inequality also holds for S = n + 1. This completes the 
proof. 

Now, we can prove the second statement which points out 
that the lowest MSE lower bound as shown in d6"TT l can be 
obtained when the numbers of groups is equal to the length 
of the parameter vector to be estimated. Following the proof 
of of Statement 1, we can express the problem that needs to 
be solved as: prove that f(L) > f(S), for any possible values 
of number of groups S, and mathematically, we need to prove 
that 



1 A 1 ^ 1 A 1 



(76) 



holds for all the possible values of S. Since the parameter 
vector is divided into a number of S groups, this inequality 
holds if the following relationship is fulfilled: 



sL/S 



> 



i 



L2 i=(.-tl/s+i (v/L) + |/l(i)|2 " S " (v/S) + h ^ s ' W 
with s = 1, 2, . . . , S 

Actually, the S — L case can be considered as the division of 
each group (with length L/S) into a number of L/S length- 
one sub-groups, and the inequality of d77l > always holds for 
each group because of Statement 1 . This completes the proof. 

References 

[1] R. C. de Lamare, M. Haardt, and R. Sampaio-Neto, "Blind Adaptive 
Constrained Reduced-Rank Parameter Estimation based on Constant 
Modulus Design for CDMA Interference Suppression," IEEE Trans. 
Signal Process., vol. 56, no. 6, pp. 2470-2482, June 2008. 

[2] R. C. de Lamare and R. Sampaio-Neto, "Reduced-Rank Space-Time 
Adaptive Interference Suppression With Joint Iterative Least Squares 
Algorithms for Spread-Spectrum Systems," IEEE Trans. Veh. TechnoL, 
vol.59, no.3, pp. 1217-1228, Mar. 2010. 



[3] Z. Wang, Y. Xin, G. Mathew, and X. Wang, "A Low-Complexity 
and Efficient Channel Estimator for Multiband OFDM-UWB Systems," 
IEEE Trans. Veh. Techno!., vol.59, no.3, pp.1355-1366, Mar. 2010. 
[4] Q. Z. Ahmed, L. L. Yang, and Sheng Chen, "Reduced-Rank Adap- 
tive Least Bit-Error-Rate Detection in Hybrid Direct-Sequence Time- 
Hopping Ultrawide Bandwidth System," IEEE Trans. Veh. TechnoL, 
vol.60, no.3, pp.849-857, Mar. 2011. 
[5] M. Marques da Silva et al., Transmission Techniques for Emergent 
Multicast and Broadcast Systems, CRC Press Auerbach Publications, 
1st Edition, ISBN: 9781439815939, Boca Raton, USA, May 2010. 
[6] S. M. Kay, Fundamentals of Statistical Signal Processing: Estimation 

Theory, Upper Saddle River, NJ:Prentice Hall, 1993. 
[7] Y. C. Eldar, A. Ben-Tal, and A. Nemirovski, "Robust Mean-Squared 
Error Estimation in the Presence of Model Uncertainties," IEEE Journal 
on Signal Processing, vol. 53, no. 1, pp. 168-181, Jan. 2005. 
[8] Y. C. Eldar, "Rethinking Biased Estimation: Improving Maximum Like- 
lihood and the Cramer-Rao Bound," Foundations and Trends in Signal 
Processing, vol. 1, no. 4, pp. 305-449, 2008. 
[9] S. Kay and Y. C. Eldar, "Rethinking Biased Estimation," IEEE Signal 
Process. Mag., pp. 133-136, May. 2008. 

[10] W. James and C. Stein, "Estimation with quadratic loss," Proc. 4th 
Berkeley Symp. Mathematical Statistics and Probability, Berkeley, CA, 
vol. 1, pp.361-379, 1961. 

[11] J. R. Thompson, "Some Shrinkage Techniques for Estimating the Mean," 
Journal of the American Statistical Association, vol. 63, no. 321, pp. 
113-122, Mar. 1968. 

[12] M. E. Bock, "Minimax estimators of the mean of a multivariate normal 
distribution," The Annals of Statistics, vol. 3, no. 1, pp. 209-218, Jan. 
1975. 

[13] S. Li, R. C. de Lamare, and M. Haardt, "Linear interference suppression 
in the frequency domain for DS-UWB systems using biased RLS 
estimation with adaptive shrinkage factors," in European Wireless (EW), 
Apr. 2011. 

[14] S. Li, R. C. de Lamare, and M. Haardt, "Adaptive frequency-domain 
biased estimation algorithms with automatic adjustment of shrinkage 
factors," in Proc. IEEE Int. Conference on Acoustics, Speech, and Signal 
Processing (ICASSP), pp. 4268 - 4271, May 2011. 

[15] J. H. Manton, V. Krishnamurthy, and H. V. Poor, "James-Stein State 
Filtering Algorithms," IEEE Trans. Signal Process., vol. 46, no. 9, pp. 
2431-2447, Sep. 1998. 

[16] Z. Ben-Haim and Y C. Eldar, "Blind Minimax Estimation," IEEE Trans. 
Inf. Theory, vol. 53, no. 9, pp. 3145-3157, Sep. 2007. 

[17] G. Durisi and S. Benedetto, "Performance evaluation of TH-PPM UWB 
systems in the presence of multiuser interference," IEEE Commun. Lett, 
vol. 7, pp. 224-226, May 2003. 

[18] R. Fisher, R. Kohno, and M. M. Laughlin et al., "DS-UWB Physical 
Layer Submission to IEEE 802.15 Task Group 3a (Doc. Number 
P802.15-04/0137r4)," IEEE P802.15, Jan. 2005. 

[19] A. F. Molisch, D. Cassioli, and C. C. Chong et al., "A Comprehensive 
Standardized Model for Ultrawideband Propagation Channels," IEEE 
Trans. Antennas Propag., vol. 54, no. 11, pp. 3151-3166, Nov. 2006. 

[20] M. Morelli, L. Sanguinetti and U. Mengali, "Channel Estimation for 
Adaptive Frequency-Domain Equalization," IEEE Trans. Wireless Com- 
mun., vol. 4, no. 5, pp. 2508-2518, Sep. 2005. 

[21] S. Li and R. C. de Lamare, "Frequency Domain Adaptive Detectors for 
SC-FDE in Multiuser DS-UWB Systems Based on Structured Channel 
Estimation and Direct Adaptation," IET Communications, vol. 4, issue. 
13, pp. 1636-1650, 2010. 

[22] M. Biguesh and A. B. Gershman, "Training-Based MIMO Channel 
Estimation: A Study of Estimator Tradeoffs and Optimal Training 
Signals," IEEE Trans. Signal Process., vol. 54, no. 3, pp. 884-893, Mar. 
2006. 

[23] J. J. de Beek, O. Edfors, M. Sandell, S. K. Wilson, and P. O. Borjesson, 
"On Channel Estimation in OFDM Systems," in Proc. IEEE VTC, pp. 
815 - 819, Jul. 1995. 

[24] O. Edfors, M. Sandell, J. J. de Beek, S. K. Wilson, and P. O. Borjesson, 
"OFDM Channel Estimation by Singular Value Decomposition," IEEE 
Trans. Commun., vol. 46, no. 7, pp. 931-939, Sep. 1998. 

[25] A. F. Molisch, D. Cassioli, and C. C. Chong et al., "A Comprehensive 
Standardized Model for Ultrawideband Propagation Channels," IEEE 
Trans. Antennas Propagat., vol. 54, no. 11, pp. 3151-3166, Nov. 2006. 

[26] M. X. Chang and C.C Yang, "A Novel Architecture of Single-Carrier 
Block Transmission DS-CDMA," in IEEE Vehicular Technology Con- 
ference (VTC), Sep. 2006. 

[27] S. Haykin, Adaptive Filter Theory, 4th Edition, Pearson Education, 2002. 



[28] J. Teng, H Snoussi, C. Richard, and R. Zhou, "Distributed Variational 
Filtering for Simultaneous Sensor Localization and Target Traching in 
Wireless Sensor Networks," IEEE Trans. Veh. Technol., vol.61, no. 5, 
pp.2305-2318, Jun. 2012. 

[29] D. B. Jourdan, D. Dardari, and M. Z. Win, "Position Error Bound for 
UWB localization in Dense Cluttered Environments," IEEE Trans. Aero. 
Elec. Sys., vol. 444, no. 2, pp. 613-628, Apr. 2008. 

[30] W. Ryan and S. Lin, Channel Codes: Classical and Modern, Cambridge 
University Press, 2009. 

[31] K. Todros and J. Tabrikian, "Uniformly Best Biased Estimators in Non- 
Bayesian Parameter Estimation," IEEE Trans. Inf. Theory, vol. 57, no. 
11, pp. 7635-7647, 2011. 

[32] M. L. Honig and J. S. Goldstein, "Adaptive reduced-rank interference 
suppression based on the multistage Wiener filter," IEEE Trans. Com- 
mun., vol. 50, no. 6, pp. 986-994, Jun. 2002. 

[33] D. A. Pados, G. N. Karystinos, "An iterative algorithm for the compu- 
tation of the MVDR filter," IEEE Trans. Sig. Proc., vol. 49, No. 2, 
February, 2001. 

[34] S. Li and R. C. de Lamare, "Reduced-Rank Linear Interference Sup- 
pression for DS-UWB Systems Based on Switched Approximations of 
Adaptive Basis Functions," IEEE Trans. Veh. Technol., vol. 60, no. 2, 
pp. 485-497, Feb. 2011. 

[35] R. C. de Lamare and R. Sampaio-Neto, "Adaptive Reduced-Rank 
Processing Based on Joint and Iterative Interpolation, Decimation, and 
Filtering," IEEE Trans. Sig. Proc, vol. 57, no. 7, pp. 2503 - 2514, July 
2009. 



PLACE 
PHOTO 
HERE 



Sheng Li (S'08 - M'll) received his Bachelor De- 
gree in Zhejiang University of Technology in China 
in 2006 and the M.Sc. degree in communications en- 
gineering and Ph.D. degree in electronics engineer- 
ing, both from the University of York, U.K. in 2007 
and 2010, respectively. In 2010, he was awarded 
the K. M. Stott prize for excellence in scientific 
research. During November 2010 to October 2011, 
he has carried out a postdoctoral research in the 
Ilmenau University of Technology, Germany. Since 
April 2012, he has been with Zhejiang University of 



PLACE 
PHOTO 
HERE 



Technology, China, where he is currently a lecturer. 



Martin Haardt (S'90 - M'98 - SM'99) has been 
a Full Professor in the Department of Electrical 
Engineering and Information Technology and Head 
of the Communications Research Laboratory at Il- 
menau University of Technology, Germany, since 
2001. Since 2012, he has also served as an Honorary 
Visiting Professor in the Department of Electronics 
at the University of York, UK. 
After studying electrical engineering at the Ruhr- 
University Bochum, Germany, and at Purdue Univer- 
sity, USA, he received his Diplom-Ingenieur (M.S.) 
degree from the Ruhr-University Bochum in 1991 and his Doktor-Ingenieur 
(Ph.D.) degree from Munich University of Technology in 1996. 
In 1997 he joint Siemens Mobile Networks in Munich, Germany, where 
he was responsible for strategic research for third generation mobile radio 
systems. From 1998 to 2001 he was the Director for International Projects 
and University Cooperations in the mobile infrastructure business of Siemens 
in Munich, where his work focused on mobile communications beyond 
the third generation. During his time at Siemens, he also taught in the 
international Master of Science in Communications Engineering program at 
Munich University of Technology. 

Martin Haardt has received the 2009 Best Paper Award from the IEEE 
Signal Processing Society, the Vodafone (formerly Mannesmann Mobilfunk) 
Innovations-Award for outstanding research in mobile communications, the 
ITG best paper award from the Association of Electrical Engineering, Elec- 
tronics, and Information Technology (VDE), and the Rohde and Schwarz 
Outstanding Dissertation Award. In the fall of 2006 and the fall of 2007 he 
was a visiting professor at the University of Nice in Sophia- Antipolis, France, 
and at the University of York, UK, respectively. His research interests include 
wireless communications, array signal processing, high-resolution parameter 
estimation, as well as numerical linear and multi-linear algebra. 
Prof. Haardt has served as an Associate Editor for the IEEE Transactions on 
Signal Processing (2002-2006 and since 2011), the IEEE Signal Processing 
Letters (2006-2010), the Research Letters in Signal Processing (2007-2009), 
the Hindawi Journal of Electrical and Computer Engineering (since 2009), the 
EURASIP Signal Processing Journal (since 201 1), and as a guest editor for the 
EURASIP Journal on Wireless Communications and Networking. He has also 
served as an elected member of the Sensor Array and Multichannel (SAM) 
technical committee of the IEEE Signal Processing Society (since 2011), as the 
technical co-chair of the IEEE International Symposiums on Personal Indoor 
and Mobile Radio Communications (PIMRC) 2005 in Berlin, Germany, as 
the technical program chair of the IEEE International Symposium on Wireless 
Communication Systems (ISWCS) 2010 in York, UK, as the general chair of 
ISWCS 2013 in Ilmenau, Germany, and as the general-co chair of the 5-th 
IEEE International Workshop on Computational Advances in Multi-Sensor 
Adaptive Processing (CAMSAP) 2013 in Saint Martin, French Caribbean. 



PLACE 
PHOTO 
HERE 



Rodrigo C. de Lamare (S'99 - M'04 - SM'10) 
received the Diploma in electronic engineering from 
the Federal University of Rio de Janeiro (UFRJ) 
in 1998 and the M.Sc. and PhD degrees, both in 
electrical engineering, from the Pontifical Catholic 
University of Rio de Janeiro (PUC-Rio) in 2001 
and 2004, respectively. Since January 2006, he has 
been with the Communications Research Group, De- 
partment of Electronics, University of York, where 
he is currently a Reader. Since April 2011, he has 
also been a Professor with PUC-RIO. His research 
interests lie in communications and signal processing, areas in which he 
has published nearly 300 papers in refereed journals and conferences. Dr. 
de Lamare serves as associate editor for the EURASIP Journal on Wireless 
Communications and Networking. He is a Senior Member of the IEEE has 
served as the General Chair of the 7th IEEE International Symposium on 
Wireless Communications Systems (ISWCS), held in York, UK in September 
2010, and will serve as the Technical Programme Chair of ISWCS 2013 in 
Ilmenau, Germany. 



